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INTRODUCTION AND REVIEW OF RELATED RESEARCH 

.1 “ 

In order to accommodate the unique learning characteristics of 
the pupil, various instructional programs have been developed and have 
been implemented in classroom practice. Of particular interest has 
been the development of individualized instructional systems that are 
responsive to the needs of the individual pupil. It is the intent of 
these programs to maximize the pupil*s opportunity to engage in se- 
lected learning experiences that are planned for his particular needs 
as he progresses through a proposed curriculum. These programs 
differ in terms of the procedures followed and the materials and 
equipment employed. Hence, the specific characteristics and objec- 
tives of a particular system should be reflected in the overt behavior 
of the pupils. Through a systematic analysis of pupil behavior, 
strengths and weaknesses of the actual operation of an instructional 
program can often be revealed relative to the stated specific goals 
of the program. For this reason, a systematic and objective analysis 
of pupil classroom activities can be a valuable aid for monitoring 
existing programs and evaluating the effectiveness of the programs. 
However, careful consideration must be given to the accuracy and 
consistency of the observational method employed in observing these 
behaviors. $ 

The development of efficient methods for observing pupil class- 
room behavior has been of concern to educators and a number of 



1 



rwwfritvi'- 



2 



( 

procedures have been defined. In general, then observational methods 
can be classified as direct or indirect. 

Direct versus Indirect Observation 

Direct 

Studies employing the direct observational method require an 

observer to be present in the classroom to classify or rate verbal or 

non-verbal behaviors directly onto an observational form or to record 

behaviors in the form of a code to be transcribed later. Sears terms 

this method of obtaining observational data a "naturalistic settings 
2 

situation. Perkins satisfactorily used the "naturalistic settings" 
situation or the direct method to determine differences between pre- 
identified underachievers and achieving fifth graders by recording 
various aspects of pupil activity type behavior, pupil verbal behavior, 

( and teacher verbal behavior presumed to be related to achievement. 

Although utilizing the direct method allows the observer to be- 
come a more integral part of the classroom, thereby facilitating the 
interpretation of the subtle changes occurring in the classroom and 
possibly increasing significantly the accuracy of the recorded behavior, 
it can be argued that an observer's presence in the classroom may 
cause the teacher and pupils to change their behavior. However, Heyns 
and Lippitt stated that it ". . . is the common feeling among experi- 
enced users of observers that the observers have very little effect, 



Pauline S. Sears, "Problems in the Investigation of Achieve- 
ment and Self-Esteem Motivation, " in Nebraska Symposium on Motiva- 
tion, ed. by M. R. Jones (Lincoln: University Press, 1957), p. 266. 

2 

Hugh V. Perkins, "A Procedure for Assessing the Classroom 
Behavior of Students and Teachers, 11 American Educational Research 
Journal , I (November, 1964), pp. 249-260. 
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if any. The belief is shared by experimenters who have worked in a 
wide variety of situations and with many different kinds of subjects. " 

A further point of view concerning direct observational proce- 
dures is that stated by Medley and Mitzel who contend that: 

If an investigator visits a group of classrooms, 
he can be sure that; regardless of his presence, he 
will see teachers teaching and pupils learning; he will 
see better and poorer teachers, effective and ineffec- 
tive methods, skillful and unskillful use of theory. If 
he does not see these things, and measure them, it 
will not be because these things are not there to see, 
record, and measure. It will be because he does not 
know what to look for, how to record it, or how to 

score the records; in short, he does not know how to 

2 

measure behavior by systematic observation. 

Therefore, for an observational study to have meaning, the 
classification system must be designed to yield data related to the prob- 
lem being investigated and the observers must be appropriately trained 
to systematically classify and record behaviors according to the system. 

The direct method of collecting systematic data can be 
advantageously employed for many purposes. For example, it 
can be used to train student teachers in the skills of effective 
teaching or it can be used as a feedback instrument to teachers for 
self-improvement. It has also been effectively employed to mea- 
sure behavior according to pre- determined psychological concepts. 



Roger W. Heyns and Ronald Lippitt, "Systematic Observational 
Techniques, 11 in Handbook of Social Psychology , Vol. I, ed. by G. 
Lindzey (Cambridge, Mass. : Addison-Wesley, 1954), p. 399- 

2 

Donald M. Medley and Harold E. Mitzel, "Measuring Class- 
room Behavior by Systematic Observation, " in Handbook of Research 
on Teaching , American Educational Research Association, ed. by N. 

L. Gage (Chicago: Rand McNally and Co. , 1963), p. 248. 
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The Flanders system, which categorizes classroom verbal interaction 

according to direct or indirect teacher influence, has been utilized for 

2 

this purpose. Brunner reported using a modification of the Flanders 
system to improve in-service and pre-service teacher training. 

Within five to ten minutes the procedure provided feedback to the 
college supervisor for discussion with the student teacher or to the 
teacher for self-analysis. 

A further advantage to the direct method is that no special 

equipment is required, such as a kinescope which was used in 
3 

Medley* s indirect student teacher behavior studies. Since no 
special equipment need be installed or transported, the mobility of 
the observer from classroom to classroom or from school to school 
is not hindered. Moreover, direct methods not only give the observer 
freedom of movement which increases observer efficiency but also 
the materials cost is low. Therefore, the expense of carrying out 
an observational study is minimum. 

Although direct methods usually require only one observer to 
obtain observational data, it must be recognized that one of the dis- 
advantages to the direct method is that there is no way of checking 



Ned A. Flanders, interaction Analysis in the Classroom: 

A Manual for Observers, 11 in Mirrors for Behavior: An Anthology of 
Classroom Observation Instruments , Vol. II (5) ed. by Anita Simon 
and E. Gil Boyer (Philadelphia, Penn. : Research for Better Schools, 
1967), pp. 1-51. 

2 

Ellen Brunner, **PIC -Profile of Interaction in the Classroom: 
A Quick Feedback of Interaction Analysis** (paper presented at the 
AERA Convention, Minneapolis, Minn., March 5, 1970), pp. 1-4. 

3 

Donald M. Medley, "Experiences with the OScAR Technique, ** 
Journal of Teacher Education , XIV (September, 1963), pp. 270-273. 
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observer classification except by placing other observers in the class- 
room at the same time, as did Cornell, Lindvall, and Saupe. ^ 

Even though the direct method has some limitations, it is 
apparent that the direct method is a feasible way of obtaining system- 
atic observational data in. an individualized classroom. 

Indirect 

The indirect method is the second general method for obtaining 
systematic classroom observations. Permanent recordings of class- 
room behavior are preserved either through handwritten manuscripts 
or with the aid of a mechanical process and then the classification of 
behaviors is carried out at a later time. For example, the indirect 
method permits verbal behaviors to be analyzed into categories from 
stenotype or audio-tape recordings and overt behaviors to be perma- 
nently recorded through movies or videotape recordings. Studies 
measuring the cognitive dimension through verbal interaction analysis 
usually employ the indirect method of observation. However, the 
indirect method can also be utilized to permanently record the activity 
type behaviors of individuals or small groups so that activities can be 
examined in detail and measured according to specific concepts being 
investigated. 

Two advantages to obtaining permanent records of behi vio.r are 
that records can be examined as often as necessary and observer 
reliability and agreement can be easily checked. Another is the 



F. G. Cornell, C. M. Lindvall, and J, L, Saupe, An Explor- 
atory Measurement of Individualities of Schools and Classrooms , 
(Urbana, Illinois: Bureau of Educational Research, University of 
Illinois, 1952), p. 37. 
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convenience of using the records in developing new instruments of 
measurement and categories of behavior which are related to the 
specific hypotheses being investigated. Withall ^ made use of tape 
recordings to study verbal interaction data in order to design an 
observation instrument and to test selected hypotheses related to 
verbal behavior. He used the recordings to develop a seven category 
system for measuring the social-emotional climate of the classroom. 

By listening to classroom statements made by teachers, a classifica- 
tion method was devised for analyzing the verbal pattern of teacher 
behavior. Withall concluded that it was possible to develop a valid 
measure of social climate through the categorization of teacher 
statements. 

The indirect method has advantages but there are certain dis- 
advantages that must be considered. If an observer is not in the class - 
^ room, he may misinterpret the mood and intention of behaviors. Also, 

the degree of deviation from natural classroom behavior to artificial 
behavior due to the psychological effect of having one's exact words 
and actions recorded or filmed has not been explored. This may be a 
more serious problem when using the indirect method than when using 
the direct method if the individuals are aware that their behavior is 
being observed. However, there are circumstances when the indirect 
method would be better. For example, an audio-tape recorder con- 
cealed in the classroom would have no effect on teacher-pupil interaction. 
Therefore, if it was not necessary to identify individual pupils, the in- 
direct method of observation may be better than the direct. 



1 John Withall, "The Development of a Technique for the Measure- 
ment of Social -Emotional Climate in Classrooms, 11 Journal of Experimental 
Education, XVII (March, 1949), pp. 347-361. 
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A further disadvantage is the high cost of installing and using 
mechanical equipment. It could limit the number of classrooms and 
schools sampled for observational studies. It might even tend to limit 
the sampling in a single classroom during a class period because of 
technical considerations. ' If a large class is engaged in independent 
study, the number of students who can be filmed during a given time 
interval is restricted. In contrast Lindvall, Yeager, Wang, and Wood 
reported that utilizing their schedule and a method of direct observa- 
tion, it was possible to account for the activities of an entire class at 
least every few minutes. 

In summary, it can be stated that although the indirect method 
has desirable features to recommend its use in classroom observa- 
tional studies, and it is better for certain types of overt and verbal 
interaction studies than the direct method, there are several qualities 
lacking which would restrict its general use in school districts. 
Limited sampling, the cost of operation, the availability of equipment, 
and in many cases the need of a skilled equipment operator are the 
main detractors for utilizing the indirect method. Therefore, the 
direct method of collecting observational data was employed in this 
study. 



Characteristics of Direct Observation 



One of the major characteristics of direct observational methods 
is that behaviors are recorded or rated directly in the classroom by at 



C. M. Lindvall, John L. Yeager, Margaret Wang, and 
Carolyn Wood, "Manual for IPI Student Observation Form, " in Mirrors 
for Behavior: An Anthology of Classroom Observation Instruments, 

Vol. Ill (12), ed. by Anita Simon and E. Gil Boyer (Philadelphia, 

Penn.: Research for Better Schools, 1967), pp. 1-3. 

( 
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least one observer. Usually the observer follows some systematic 
classification system to record verbal and activity type or overt 
behaviors. 

The specific characteristics of each system of observation are 
determined by the purpose and assumptions of the research. Charac- 
teristics of various systems can best be reviewed by examining a 
number of specific studies and the instruments used. 

Recently Spaulding^ reported the development of a method for 
coding the overt behaviors of pupils in the classroom. This method 
was designed to obtain case studies of the activities of pupils in 
order to determine their management of classroom time. Each 
behavior was to be classified into one of thirteen categories. The 
categories of the instrument were based on the psychological concepts 
of integrative and dominative social behavior, and the grouping of 
passive behaviors were at one end and aggressive behaviors at the 
other end. Because Spaulding's procedure was specifically designed 
for case studies, it might be easily adapted for use in an individualized 
classroom. One difficulty, however, in using this instrument is that 
the observer training period is from two to three weeks in length. 

Another study of classroom activities was that of Cornell^ 

2 

Lindvall, and Saupe which discussed the systematic observational data 
obtained on organizational procedures and the social-emotional climate 



Robert L. Spaulding, An Introduction to the Use of Coping 
Analysis Schedule for Educational Settings (CASES) and the Spaulding 
Teacher Activity Rating Schedule (STARS) , (Durham, North Carolina: 
Duke University, Education Improvement Program, 1967), pp. 1-18. 

2 

Cornell, Lindvall, and Saupe, An Exploratory Measurement, 
pp. 1-71. 
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of a variety of classrooms in different school systems. Various types 
of behaviors were classified onto a schedule organized in the following 
manner: (1) differentiation- -work difference, (2) social organization- - 
teacher-pupil organization, (3) pupil initiative- -teacher or pupil control, 
(4) content- -material used, (5) variety- -activities taking place, 

(6) competency- -teacher, (7) climate- -teacher, and (8) climate- -pupil. 
Extensive information was collected on each of these dimensions, and 
it was concluded that it was possible to measure differences between 
classrooms through direct systematic behavior classification of class- 
room activities. Another detailed study concerning pupil activities was 
undertaken by Medley and Mitzel. ^ The method employed a schedule 
developed by the authors which was called "the OScAR". This schedule 
was divided into the following sections: (1) activity, (2) grouping, 

(3) sign, (4) material, (5) expressive behavior, and (6) subject. As 
pointed out by Medley and Mitzel, one of the desirable features of the 
OScAR is that no interpretation of behavior by the observer beyond 
rather obvious classification is necessary. Therefore, highly trained 
observers were not necessary. Both the Cornell, Lindvall, and Saupe 
schedule and the OScAR were devised to measure the social and 
emotional dimensions of the classroom and to record the diversity of 

activities in which the teacher and pupils engage. 

2 

Kowatrakul introduced another system that was designed to 
measure individual behaviors in the classroom. The observation 



^Donald M. Medley and Harold E. Mitzel, "A Technique for 
Measuring Classroom Behavior, " Journal of Educational Psychology , 
XLIX (April, 1958), pp. 86-92. 

2 

Surang Kowatrakul, "Some Behaviors of Elementary School 
Children Related to Classroom Activities and Subject Areas, " Journal 
of Educational Psychology, L (July, 1959)» pp. 121-128. 
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schedule was divided into the categories of: (1) intent on ongoing 
work, (2) social work, (3) social-friendly, (4) momentary withdrawal, 
(5) intent on work in another academic area, and (6) intent on work in 
non-academic area. By recording observational data while students 
were engaged in independent seat work, watching-listening and dis- 
cussion, Kowatrakul was able to study the effect of the nature of class- 
room activity on the behavior of individual pupil3. Perkins * reported 
that he expanded Kowatrakul' s six categories to nine for a part of his 
study of achieving and underachieving elementary school students. 

To determine the difference between control and activity type 

2 

schools, Thorndike, Lotus and Goldman employed a method which 
involved systematically observing five students from each of thirty- 
two schools. The categories were derived from direct descriptive 
data and were mainly concerned with measuring the social dimension. 
They are listed as follows: (1) contribution to recitation or discussion, 
(2) working as an individual- -as signed work, (3) teacher originated 
activity but not directed, (4) self-originated activity, (5) observes or 
passively attends, (6) cooperates with class routine, (7) gives or 
receives cooperation, (8) communicates with another pupil, 

(9) inactive or unattentive, (10) fidgets, (11) displays feeling, 

(12) disciplines or is disciplined, and (13) commends or is com- 
mended. When these categories were checked directly in the class- 
rooms of activity and control type schools, the results indicated 



Perkins, "Assessing Classroom Behaviors, 11 pp. 250-251. 

2 

Robert L. Thorndike, John L. Loftus, and Bernard Goldman, 
"Observations of the Behavior of Children in Activity and Control 
Schools, " Journal of Experimental Education, X (December, 1941), 
pp. 138-145. 
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that there were more similarities than differences between the 
behaviors recorded for the two types. 

A schedule has been developed by Lindvall, Yeager* Wang, and 
Wood* to measure the activities of an entire individualized classroom 
or an individual who is part of the class. All classroom activity is 
recorded at designated time intervals into one of the following cate- 
gories: (1) independent work, (2) teacher-pupil activity, (3) non- 
instructional activity, (4) pupil-pupil activity, and (5) group activity. 
Considering the previously discussed classroom dimensions, this 
instrument can be characterized as measuring the social dimension 
since no behavioral recordings pertaining to the emotional climate are 
made, i. e. , teacher reinforcements, classroom moods, etc. One 
highly desirable feature of the schedule is that an extensive training 
period is not required for observers because the listed activities 
are easily recognizable and do not require extensive interpretation. 

Technical Aspects of Activity Type Observations 

As has been previously stated, one of the objectives of this 
research was to obtain a reliable method for observing individualized 
classes; therefore, reliability was one of the critical factors which 
determined the selected method recommended as a result of 
this study. Various segments of an observational procedure must be 
examined, so that the total resulting method is a reliable one and not 
biased by some overlooked inadequacy. The following discussion will 
review reliability, sampling, and the selection of time units. Careful 



^Lindvall, Yeager, Wang and Wood, "Manual for IPI Student 
Observation Form, " pp. 1-3. 
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consideration of each of these aspects is essential to obtaining an 
efficient observational method. 

Reliability 

One type of reliability which has been of concern to several 

researchers, has been the reliability of the observer in recording 

activities. In order to control this element, Cornell, Lindvall, and 

Saupe* placed two observers in the classroom at the same time, each 

recording data independent of the other. This ability of two observers 

to agree on the same category has been termed category reliability by 

2 

Moustakas, Sigel, and Schalock and the proportion of agreements to 

the total sum of agreements and disagreements has been called observer 

3 

reliability. As Medley and Mitzel stressed, these factors are con- 
trolled to a large extent by the objectivity of the system, for as the 

subjectivity of coding increases, observer agreement of coding 

4 

behaviors decreases. Withall determined the objectivity of his in- 
strument by comparing his classification of verbal teacher statements 
to the number of identical statements placed in the same category by 



Cornell, Lindvall, and Saupe, An Exploratory Measurement, 

p. 37. 

2 

Clark E. Moustakas, Irving E. Sigel, and Henry D. Schalock, 
"An Objective Method for the Measurement and Analysis of Child-Adult 
Interaction, 11 Child Development, XXVII (June, 1956), pp. 127-131. 

3 

Medley and Mitzel, "Measuring Classroom Behavior, " 
pp. 254, 276. 

4 

Withall, "Measurement of Social -Emotional Climate, " 



p. 350. 



